Learning to Select Pre-Trained Deep Representations with Bayesian Evidence Framework

We propose a Bayesian evidence framework to facilitate transfer learning from pre-trained deep convolutional neural networks (CNNs). Our framework is formulated on top of a least squares SVM (LS-SVM) classifier, which is simple and fast in both training and testing, and achieves competitive performance in practice. The regularization parameters in LS-SVM is estimated automatically without grid search and cross-validation by maximizing evidence, which is a useful measure to select the best performing CNN out of multiple candidates for transfer learning; the evidence is optimized efficiently by employing Aitken's delta-squared process, which accelerates convergence of fixed point update. The proposed Bayesian evidence framework also provides a good solution to identify the best ensemble of heterogeneous CNNs through a greedy algorithm. Our Bayesian evidence framework for transfer learning is tested on 12 visual recognition datasets and illustrates the state-of-the-art performance consistently in terms of prediction accuracy and modeling efficiency.Comment: Appearing in CVPR-2016 (oral presentation

MOVIN: Real-time Motion Capture using a Single LiDAR

Recent advancements in technology have brought forth new forms of interactive applications, such as the social metaverse, where end users interact with each other through their virtual avatars. In such applications, precise full-body tracking is essential for an immersive experience and a sense of embodiment with the virtual avatar. However, current motion capture systems are not easily accessible to end users due to their high cost, the requirement for special skills to operate them, or the discomfort associated with wearable devices. In this paper, we present MOVIN, the data-driven generative method for real-time motion capture with global tracking, using a single LiDAR sensor. Our autoregressive conditional variational autoencoder (CVAE) model learns the distribution of pose variations conditioned on the given 3D point cloud from LiDAR.As a central factor for high-accuracy motion capture, we propose a novel feature encoder to learn the correlation between the historical 3D point cloud data and global, local pose features, resulting in effective learning of the pose prior. Global pose features include root translation, rotation, and foot contacts, while local features comprise joint positions and rotations. Subsequently, a pose generator takes into account the sampled latent variable along with the features from the previous frame to generate a plausible current pose. Our framework accurately predicts the performer's 3D global information and local joint details while effectively considering temporally coherent movements across frames. We demonstrate the effectiveness of our architecture through quantitative and qualitative evaluations, comparing it against state-of-the-art methods. Additionally, we implement a real-time application to showcase our method in real-world scenarios. MOVIN dataset is available at \url{https://movin3d.github.io/movin_pg2023/}

Development of a safety education program using simulator fire extinguishers in Korea: Focusing on elementary school students

Safety education aims to promote safe habits through experience-oriented education that combines knowledge, skills  and attitudes. However, in situations where experience-oriented safety education is challenging, realistic content created through technological advancements can indirectly function as an excellent safety education tool that allows for individual safety experiences. This study conducted a safety education program for 34 elementary school students using the most commonly used realistic safety education content in Korea, the 'simulator fire extinguisher,' four times. Safety knowledge tests and safety problem-solving ability tests were used as measuring tools and statistical significance was verified through paired sample t-tests. This study demonstrated that the safety education program using the 'simulator fire extinguisher' was effective in improving safety knowledge and problem-solving abilities . The average score of elementary school students increased from 8.47 to 9.23 in safety knowledge tests and from 4.26 to 4.64 in safety problem-solving ability tests. These results were statistically significant (p < 0.001)

Spheroidization Heat Treatment Conditions with Data Analysis in Medium Carbon Cr-Mo Steel for Ultra High Strength Cold Heading

The degree to which parameters affect the spheroidization heat treatment of steel was calculated by setting the spheroidization heat treatment conditions of Cr-Mo steel and using data analysis such as S/N ratio and ANOVA. After analyzing the transformation temperatures of the steel, Ac1 and Ac3, using a DSC, the conditions were set accordingly. The surface hardness was measured for the conditions and used as an evaluation index. The correlation was analyzed by comparing the spheroidized volume fraction and the surface hardness, and the Pearson correlation coefficient was -0.88, proving that a correlation existed between the two values. Using S/N ratio and ANOVA, the degree to which each control parameter affects the decrease in the surface hardness was analyzed, qualitatively and quantitatively. For the S/N ratio, priority affecting the surface hardness for each control parameter was analyzed. The 1st heating temperature was found to have a more preferential effect on the surface hardness than the 1st heating time and the 2nd heating temperature. Using ANOVA, the 1st heating temperature was determined to be a very significant factor with the greatest influence, contributing 73.2% to the surface hardness. Intercritical annealing is a suitable spheroidization heat treatment condition, so if the surface hardness of the steel needs to be reduced using Intercritical annealing, the 1st heating temperature and time should be designed as the priority

Two major gate-keepers in the self-renewal of neural stem cells: Erk1/2 and PLCγ1 in FGFR signaling

Neural stem cells are undifferentiated precursor cells that proliferate, self-renew, and give rise to neuronal and glial lineages. Understanding the molecular mechanisms underlying their self-renewal is an important aspect in neural stem cell biology. The regulation mechanisms governing self-renewal of neural stem cells and the signaling pathways responsible for the proliferation and maintenance of adult stem cells remain largely unknown. In this issue of Molecular Brain [Ma DK et al. Molecular genetic analysis of FGFR1 signaling reveals distinct roles of MAPK and PLCγ1 activation for self-renewal of adult neural stem cells. Molecular Brain 2009, 2:16], characterized the different roles of MAPK and PLCγ1 in FGFR1 signaling in the self-renewal of neural stem cells. These novel findings provide insights into basic neural stem cell biology and clinical applications of potential stem-cell-based therapy

Proteomic Analysis of Calcium- and Phosphorylation-dependentCalmodulin Complexes in Mammalian Cells

Protein conformational changes due to cofactor binding (e.g. metal ions, heme) and/or posttranslational modifications (e.g. phosphorylation) modulate dynamic protein complexes. Calmodulin (CaM) plays an essential role in regulating calcium (Ca{sup 2+}) signaling and homeostasis. No systematic approach on the identification of phosphorylation-dependent Ca{sup 2+}/CaM binding proteins has been published. Herein, we report a proteome-wide study of phosphorylation-dependent CaM binding proteins from mammalian cells. This method, termed 'Dynamic Phosphoprotein Complex Trapping', 'DPPC Trapping' for short, utilizes a combination of in vivo and in vitro assays. The basic strategy is to drastically shift the equilibrium towards endogenous phosphorylation of Ser, Thr, and Tyr at the global scale by inhibiting corresponding phosphatases in vivo. The phosphorylation-dependent calmodulin-binding proteins are then trapped in vitro in a Ca{sup 2+}-dependent manner by CaM-Sepharose chromatography. Finally, the isolated calmodulin-binding proteins are separated by SDS-PAGE and identified by LC/MS/MS. In parallel, the phosphorylation-dependent binding is visualized by silver staining and/or Western blotting. Using this method, we selectively identified over 120 CaM-associated proteins including many previously uncharacterized. We verified ubiquitin-protein ligase EDD1, inositol 1, 4, 5-triphosphate receptor type 1 (IP{sub 3}R1), and ATP-dependent RNA helicase DEAD box protein 3 (DDX3), as phosphorylation-dependent CaM binding proteins. To demonstrate the utilities of our method in understanding biological pathways, we showed that pSer/Thr of IP{sub 3}R1 in vivo by staurosporine-sensitive kinase(s), but not by PKA/PKG/PKC, significantly reduced the affinity of its Ca{sup 2+}-dependent CaM binding. However, pSer/Thr of IP{sub 3}R1 did not substantially affect its Ca{sup 2+}-independent CaM binding. We further showed that phosphatase PP1, but not PP2A or PP2B, plays a critical role in modulating the phosphorylation-dependent CaM binding for IP{sub 3}R1. If combined with other phosphoprotein and phosphopeptide enrichment techniques such as IMAC, our method may serve as a general strategy to identify and characterize phosphorylation-dependent and functionally important protein complexes in mammalian cells

Influence of oxygen vacancy on the electronic structure of HfO2_2 film

We investigated the unoccupied part of the electronic structure of the oxygen-deficient hafnium oxide (HfO$_{\sim1.8}$) using soft x-ray absorption spectroscopy at O $K$ and Hf $N_3$ edges. Band-tail states beneath the unoccupied Hf 5$d$ band are observed in the O $K$-edge spectra; combined with ultraviolet photoemission spectrum, this indicates the non-negligible occupation of Hf 5$d$ state. However, Hf $N_3$-edge magnetic circular dichroism spectrum reveals the absence of a long-range ferromagnetic spin order in the oxide. Thus the small amount of $d$ electron gained by the vacancy formation does not show inter-site correlation, contrary to a recent report [M. Venkatesan {\it et al.}, Nature {\bf 430}, 630 (2004)].Comment: 5 pages, 4 figures, submitted to Phys. Rev.